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PACKET ROUTING TO REDUCE SUSCEPTIBILITY TO DISTURBANCES 

TECHNICAL FIELD OF THE INVENTION 

The present invention relates generally to packet-based communications and 
more particularly to packet routing to reduce susceptibility to disturbances. 
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BACKGROUND OF THE INVENTION 

To deliver high bandwidth low cost communications solutions, many 
organizations and individuals use packet-based communications systems. These 
systems may support various types of communications, including the communication 
of streaming data such as voice or video. However, a major impediment towards 
widespread acceptance of packet-based communications is a perceived susceptibility 
of these systems to interferences that cause packet loss. For example, during a voice 
over IP (VoIP) communication session, transient or chronic disturbances can 
significantly impact perceived quality of the communications. 
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SUMMARY OF THE INVENTION 

In accordance with the present invention, techniques for packet routing to 
reduce susceptibility to disturbances are provide that substantially eliminate or reduce 
disadvantages and problems associated with previous techniques. In a particular 
5 embodiment, the present invention satisfies a need for a system that separates packets 

associated with a communication session among multiple available routes to reduce 
perceptible quality degradations caused by disturbances in only some of the routes. 
For example, a router in a communications system may receive a stream of packets 
for a communication session, determine multiple paths to deliver the packets to a 

10 recipient, separate the packets into multiple streams, and communicate each of the 

streams to the recipient along a separate path. 

In accordance with one embodiment of the present invention, a method for 
communicating packets to a remote device receives packets encoding streaming data 
for delivery to a remote device, with each of the packets including a sequence 

15 number. The method separates the packets into streams corresponding to multiple 

paths to the remote device, with each of the streams including a subset of the packets 
having no more than a predetermined number of consecutive sequence numbers. The 
method then communicates the streams using the corresponding paths to reduce 
susceptibility to a disturbance on one of the paths. 

20 In accordance with another embodiment of the present invention, a network 

node includes a network interface that couples to multiple paths to a remote device. 
The network interface receives packets encoding streaming data for delivery to the 
remote device, with each of the packets including a sequence number. The network 
node also includes a processor that separates the packets into streams corresponding 

25 to the paths, with each of the streams including a subset of the packets having no 

more than a predetermined number of consecutive sequence numbers. The network 
interface of the network node communicates these streams on the corresponding paths 
to reduce susceptibility to disturbance on one of the paths. 

Various embodiments of the present invention provide a number of technical 

30 advantages. Using these techniques, a system may provide relatively reliable packet- 

based communications even when disturbances affect selected routes between 
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communications devices. By communicating streaming data over a number of 
separate paths, a disturbance or disturbances along one of these paths affects only a 
limited number of the packets associated with the communication session. When the 
streams are intelligently distributed among available paths, a system may reduce or 
5 eliminate susceptibility to quality degradation due to disturbances on one of the paths. 

For example, a device in the system, after identifying multiple paths to a recipient, 
may alternate between the paths to communicate each subsequent packet using a 
different path than the previous packet. This substantially reduces the probability of 
sequential packet loss since a disturbance on one of the paths will not result in the loss 
10 of sequential packets. This increases the recoverability of received packet 

communications, since the data from lost of damaged packets may be recovered or 
estimated using techniques such as interpolation or extrapolation. Moreover, the loss 
of non-sequential packets affects perceived quality less than the loss of a block of 
sequential packets. 

15 Other technical advantages of the present invention will be readily apparent to 

one skilled in the art from the following figures, descriptions, and claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 illustrates a communications system implementing packet routing 
according to the present invention; 

FIGURE 2 is a block diagram illustrating a router from the system that routes 
packets of a communication session among multiple available routes; 

FIGURE 3 is a timing diagram illustrating advantages of a particular packet 
routing algorithm using multiple routes as compared to a single-route communications 
scheme; and 

FIGURE 4 is a flowchart of a method for distributing packets associated with 
a communication session for communication using multiple routes to a destination. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

FIGURE 1 illustrates a communications system, indicated generally at 10, that 
includes communications devices 12 coupled using a communications network 14. 
Within network 14, routers 18 direct packets along various physical routes to support 
5 packet-based communications, such as communication sessions between device 12 

labeled A (Device A) and device 12 labeled B (Device B). In general, devices 12 
establish packet-based, connectionless communication sessions using network 14. 
Through the operation of devices 12 and/or routers 18, network 14 routes various 
packets associated with a communication session along different physical paths. For 

10 example, a selected router 18 may separate packets associated with a communication 
session into multiple streams and communicate each stream to a destination using 
different physical paths. 

Devices 12 represent communications equipment, including hardware and/or 
software, capable of supporting packet-based communications. For example, devices 

15 12 may represent personal computers, internet protocol (IP) telephones, wireless 

communications devices, or any other suitable communications equipment. Devices 
12 couple to network 14 via one or more wireless or wireline links. Thus, devices 12 
may couple to multiple components of network 14 and, using these multiple available 
links, may distribute packets of a communication session for communication to a 

20 remote destination using different links corresponding to different physical paths. 

Alternatively or in addition, devices may establish virtual paths using any suitable 
routing protocols, with each virtual path corresponding to a different physical path 
through network 14. Thus, even when connected to network 14 using a single link, a 
selected device 12 may establish multiple physical paths for communicating packets 

25 to a destination. 

Network 14 represents any suitable collection and arrangement of 
communications equipment supporting transport and delivery of packets. For 
example, network 14 may be one or a collection of components associated with the 
public switched telephone network (PSTN), local area networks (LANs), wide area 

30 networks (WANs), a global computer network such as the internet, or any other 
communications equipment suitable for providing wireless and/or wireline 
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communications. In the embodiment illustrated, network 14 includes routers 18, 
which link using any suitable physical transmission media and/or communications 
equipment to form a mesh supporting packet-based communications between devices 
12. 

5 Thus, routers 18 represent communications equipment, including hardware 

and/or software, operable to receive, route, and transmit packets. In addition, selected 
routers 18 may provide intelligent routing of packets associated with individual 
communication sessions to potentially enhance reliability and reduce susceptibility of 
the sessions to various disturbances. These disturbances represent conditions that 

10 potentially affect quality as perceived by recipients, such as interference or other 

communications failures resulting in packet corruption or packet loss, and also 
represent malicious and/or deliberate acts by third parties, such as "snooping" on a 
packet-based communication session. 

In operation, devices 12 establish packet-based communication sessions and 

15 communicate information to each other using network 14. According to a particular 

embodiment, selected routers 18 in network 14 operate to separate packets associated 
with the communication session into multiple streams for delivery to recipients using 
various physical paths. Consider the example provided by the embodiment 
illustrated. In this example, Device A and Device B have established a packet-based 

20 communication session through links with network 14. Device A couples to router 1 8 
labeled A (Router A) while Device B couples to router 18 labeled B (Router B). 
During setup of the communication session or at any other appropriate time, Router A 
determines available physical paths for delivering packets from Device A to Device 
B. Router A may select some or all of these paths for use in communicating selected 

25 packets from Device A to Device B. 

In setting up a communication session for delivery of packets along multiple 
paths, Router A may use any suitable techniques for selecting paths and determining 
an appropriate separation algorithm for allocating various packets among selected 
communications paths. In a particular embodiment, routers 18 may identify reliable, 

30 high-speed routes for communicating time-sensitive packets and determine slower- 

speed routes for communicating non-time-critical packets. For example, Router A 
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may communicate streaming data, such as voice information, on available high-speed 
routes while cornmunicating signaling information for the communication session on 
slower routes. However, routers 18 may use any suitable characteristics and/or 
information for available paths to select appropriate paths and determine an algorithm 
5 for separating packets of a communication session among the selected paths. For 

example, routers 18 may monitor congestion along paths, packet delay or packet 
losses associated with paths, and other appropriate metrics for identifying and 
selecting suitable paths. Moreover, routers 18 may monitor characteristics of various 
available paths and selected paths during a communication session and, in response to 

10 changes in these values, modify path selections and/or modify algorithms for 
distributing packets among selected paths. Thus, a separation algorithm may 
dynamically adapt to changing network conditions. 

During the communication session between Device A and Device B, Device A 
may communicate packets for delivery to Device B. In the example, as illustrated at 

15 20, Device A communicates a stream of packets, labeled one through six, to Router A 

for delivery to Device B. Upon receiving each packet, Router A determines an 
appropriate path for delivering the received packet to Device B and routes the packet 
on this path. In the example illustrated, Router A implements an algorithm in which 
sequential packets are communicated down alternating routes. Thus, using three 

20 available routes, Router A communicates the first packet down a first path, the second 

packet down a second path, and the third packet down a third path. Router A then 
communicates the fourth packet down the first path, the fifth packet down the second 
path, and the sixth packet down the third path. This separation algorithm significantly 
reduces the probability of sequential packet loss since disturbance on a single path 

25 will affect only every third packet. This can drastically improve the ability of 
receiving devices to recover communications through techniques such as digital signal 
processing. Therefore, in certain circumstances, separation algorithms may 
drastically improve perceived quality by the recipient even given disturbances in 
network 14 that result in packet loss and/or degradation. 

30 However, while the example illustrated provides a specific method for 

separating packets among available paths, system 10 contemplates devices 12 and/or 
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routers 18 using any appropriate techniques for distributing packets among available 
paths. For example, given some predetermined number of sequential packets that 
may be lost without significantly affecting perceived quality, devices 12 and/or 
routers 18 may attempt to assure that no more than this predetermined number of 
5 sequential packets are communicated along the same physical path. Thus, if no more 

than two sequential packets may be lost before significantly affecting perceived 
quality, device 12 and/or routers 18 may attempt to insure that no more than two 
sequential packets propagate along the same physical path. 

In addition, while the example illustrated demonstrates a particular router 18 

10 implementing path selection and routing of packets along the selected paths, system 
10 contemplates devices 12, routers 18, and/or other appropriate communications 
equipment identifying and selecting available paths and determining appropriate 
separation algorithms for distributing packets among available paths. Moreover, 
while this example focuses only on communications from Device A to Device B, 

15 packets from Device B to Device A may be similarly split among selected paths. For 

example, Router B may select identical or alternate paths as selected by Router A for 
communicating packets from Device B to Device A. Thus, elements may act 
independently in selecting paths and developing separation algorithms. Moreover, 
each separate stream of packets may be further divided for communication on 

20 multiple available routes, resulting in packets branching out through network 14 yet 

still being delivered to a single recipient. 

According to particular embodiments, routers 18 communicate to form logical 
communication paths for each separate stream of packets for a communication 
session. Using the logical paths, routers 18 monitor network performance along the 

25 multiple paths used for delivering packets. For example, in the embodiment 

illustrated, router A communicates packets for the communication session along three 
separate paths to router B. Thus, router A and router B establish three logical 
communication paths to track the operation of each separate path. This permits router 
A and router B to determine, for example, which packets are successfully 

30 communicated along each path and determine when packets along one of the paths are 
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lost. Therefore, routers A and B can detect and respond to chronic disturbances along 
one or more of the paths selected for delivering packets. 

FIGURE 2 is a block diagram illustrating functional components of an 
exemplary router 18 that include a processor 30, an interface 32, and a memory 34. 
5 Interface 32 couples router 18 to other communications equipment, such as other 

routers 18, devices 12, and other elements of network 14. More specifically, router 18 
may identify available physical paths for delivering packets associated with a 
communication session to a destination, develop or access an algorithm for separating 
received packets among the paths, and then communicate packets for the session 

1 0 using some or all of the available paths. 

Memory 34 supports the operation of elements within router 18 by 
maintaining information in long or short term storage. Thus, memory 34 represents 
any collection and arrangement of volatile or non-volatile, local or remote devices 
suitable for storing data, for example, random access memory (RAM) devices, read 

15 only memory (ROM) devices, magnetic storage devices, optical storage devices, or 

any other suitable data storage devices. In the embodiment illustrated, memory 34 
stores topological information 36, logic 38, and session information 40. Topological 
information 36 represents information for identifying, selecting, and routing among 
various paths through network 14. For example, topological information 36 may 

20 include a topology of elements in network 14, addressing information, performance 

information for various links in network 14, characteristics of various links, and other 
appropriate information for describing the availability and accessibility of elements in 
and attached to network 14. Router 18 may periodically or sporadically refresh some 
or all of topological information 36 and use the changing information to dynamically 

25 adjust selected paths and separation algorithms for communication sessions. 

To control operation of elements of router 18, process and analyze topological 
information 36 and session information 40, and perform other suitable processing, 
memory 34 includes logic 38. Logic 38 represents algorithms, software, code and/or 
other appropriate modules for use by router 18. For example, logic 38 may include 

30 programs for execution by processor 30 to analyze topological information 36 and 

identify and select from available paths for communicating packets to destinations. In 
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addition, logic 38 may include separation algorithms for statically and/or dynamically 
determining appropriate distribution of packets among available communications 
paths. 

Session data 40 includes information describing communication sessions 
5 established by devices 12. Router 18 uses session data 40 for distributing packets 

associated with each session among available paths. For example, upon device 12 
establishing a communication session passing through router 18, router 18 may 
generate session data 40 for that session. These data may include information such as 
addresses of participants, available paths, selected paths, algorithms for use in 

10 distributing packets among selected paths, current sequence numbers of the session, 

and other suitable information for use by router 18 in communicating packets 
associated with the session using multiple available paths. 

Interface 32 provides multiple links to other elements of network 14 and to 
devices 12. These links represent physical and/or virtual communications paths for 

1 5 communicating information to remote communications equipment. Using these links, 

router 18 receives packets associated with communication sessions and routes the 
packets for each communication session for delivery to a remote destination using 
multiple physical paths. To coordinate operation of its various elements, router 1 8 
includes processor 30. Processor 30 represents any one or collection of 

20 microprocessors, controllers, or other suitable logic devices. For example, processor 

30 may represent a microprocessor or group of microprocessors executing instructions 
stored by memory 34. 

In operation, router 18 receives packets associated with communication 
sessions of devices 12 and, for each communication session, separates packets into 

25 various streams for communication to a destination using different physical paths. As 

previously discussed, router 18 may use any suitable algorithm for separating and 
communicating packets. These algorithms may separate packets based on header 
information such as sequence numbers, arrival times, contents of the packets, network 
characteristics such as congestion, capacity, and historical data on network 

30 performance, and/or any other suitable information and criteria. For example, during 

a communication session, a particular device 12 may stream data encoded in packets 

DAL0 1:587621 



ATTORNEY'S DOCKET 
062891.0519 



12 



PATENT APPLICATION 



for delivery to a destination. While receiving the packets, router 18 separates the 
packets into multiple streams and communicates each stream on a separate path to the 
destination. 

Consider the example illustrated by the embodiment of router 18 having an 
5 interface 32 with multiple available paths. Using a first path, interface 32 receives 

packets one through six for routing to a destination. In the embodiment illustrated, 
router 18 communicates each subsequent packet using a different available route 
corresponding to a different physical path to reach the destination. Thus, router 18 
communicates packet one using a first available route to reach the destination, packet 

10 two using a second available route, and packet three using a third available route. 

After exhausting all selected paths, router 18 returns to the first available path. Thus, 
router 18 communicates packet four using the first available route, packet five using 
the second route, and packet six using the third route. However, while this example 
illustrates a specific embodiment of router 18 implementing a particular separation 

15 algorithm, system 10 contemplates routers 18 and/or devices 12 using any suitable 

techniques and algorithms for communicating packets associated with a 
communication session for delivery to a destination via different physical paths. 
Thus, while the preceding example focuses on the operation of router 18 in receiving 
and separating streams of packets, system 10 contemplates device 12 performing 

20 some or all of the functions described for router 18 in determining available paths, 

selecting particular paths, and communicating packets for delivery to a remote 
destination by separating the packets among the selected paths. 

Moreover, while this example includes specific functional elements for router 
18, system 10 contemplates router 18 containing any collection and arrangement of 

25 suitable elements. Thus, while the embodiment illustrates specific functional 

elements, router 18 may include other elements providing various functions for 
receiving, processing, and communicating packets. In addition, system 10 
contemplates implementing each of the functional elements within router 18 using 
any appropriate combination and arrangement of hardware and/or software and 

30 implementing any of the functionalities using logic encoded in a storage medium, 

such as a computer program maintained in a computer-readable data storage medium. 
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FIGURE 3 is a timing diagram illustrating benefits of communicating packets 
associated with a communication session along multiple physical paths as compared 
to techniques using only a single path for the communication of packets. This 
illustration includes a representation of a stream of packets generated by device 12, as 

5 indicated at 50, for delivery to a remote destination. In this example, network 14 

provides multiple available physical paths for communicating these packets from 
device 12 to the remote destination. Along one of these paths, a disturbance, 
indicated at 52, operates to disrupt any packets traveling along this path. Thus, a 
system communicating packets for a communication session along the path affected 

.0 by disturbance 52 will experience total packet loss during disturbance 52. Thus, as 

indicated at 54, the destination address receives a series of packets missing a large 
sequential block of data. During a communication session involving streaming data, 
such as voice communications, this loss of a block of sequential packets may result in 
serious, perceptible quality degradations. 

5 By communicating packets of the communication session on multiple physical 

paths, disturbance 52 along a single path results in a far less significant impact upon 
received packets. For example, in a voice communication session, digital signal 
processing resources at the endpoints can process received packets to compensate for 
packets lost, thus minimizing the perceived degradations of voice quality. This 

10 illustration assumes that packets for the communication session are alternated along 

three available physical paths, with only a single one of these paths affected by 
disturbance 52. Thus, the destination address receives a larger percentage of the 
communicated packets, as indicated at 56, given disturbance 52 along one of the paths 
in use. Moreover, as is apparent by this illustration, packet loss may be limited to 

5 non-sequential packets, thus preventing the loss of blocks of sequential data. In 

certain circumstances, the amount and distribution of packets received by a 
destination address, even given disturbances along selected paths, may provide 
sufficient information to significantly or completely alleviate quality degradations. 
Moreover, the non-sequential nature of packet loss resulting from these packet 

0 separation techniques enables more effective and efficient recovery of lost data using 

techniques such as interpolation or extrapolation. 
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While the preceding diagram provides a particular example of the effects of a 
disturbance on received packets, the example is provided merely for illustrative 
purposes and, as previously discussed, system 10 contemplates using any suitable 
techniques and algorithms for separating packets among multiple available 
5 communications routes. 

FIGURE 4 is a flow-chart illustrating a method for separating packets 
associated with a communication session and communicating the separated packets 
using multiple available physical paths. Router 18 monitors network 14 at step 100 
for packets and may also monitor characteristics of network 14, such as congestion, 
10 and store these characteristics as topological information 36. Router 18 receives a 

packet destined for a remote device at step 102 and determines whether a separation 
algorithm has been established for routing the received packet at step 104. For 
example, by determining identifying information indicated by a header of the packet, 
router 18 may access session data 40 to determine whether a separation algorithm has 
15 been established for the communication session. If so, router 18 determines a path 

according to the algorithm at step 112 and communicates the packet on the selected 
path at step 114. 

However, if router 18 determines that a separation algorithm has yet to be 
established for this communication session, router 18 may determine whether network 

20 14 provides multiple paths to the remote device at step 106. If not, router 18 

communicates the packet on the one available path at step 108. However, if router 18 
identifies multiple paths to the remote device, router 18 may establish a separation 
algorithm at step 110. For example, router 18 may determine a particular algorithm 
maintained by logic 38 for use in separating received packets among multiple paths to 

25 the remote device. In addition, router 18 may also establish session data 40 for the 

communication session associated with the packet. This permits router 18 to process 
future received packets of the communication session using the predetermined session 
data 40. Upon establishing a separation algorithm, router 18 determines a path 
according to the algorithm at step 112 and communicates the packet on the selected 

30 path at step 114. Therefore, using these techniques, router 18 may process received 
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packets such that network 14 transports packets associated with a communication 
session to destinations using multiple available physical paths. 

While this flow-chart illustrates an exemplary method of operation, system 10 
contemplates routers 18 using any suitable techniques for communicating packets 
5 associated with a communication session using multiple available routes. Thus, many 

of the steps in this flow-chart may take place simultaneously and/or in different orders 
than is shown. In addition, system 10 contemplates any suitable distribution or 
separation of setup and management of session data 40 and separation algorithms. 
For example, device 12 may establish a separation algorithm and select from the 
10 available paths, while router 18 implements the selected algorithm. Furthermore, 
system 10 contemplates routers 18 using methods with additional steps, fewer steps, 
and/or different steps, so long as the methods remain appropriate for communicating 
packets associated with a communication session using multiple available physical 
paths. 

15 Although the present invention has been described in several embodiments, a 

myriad of changes and modifications may be suggested to one skilled in the art, and it 
is intended that the present invention encompass such changes and modifications as 
fall within the scope of the present appended claims. 
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